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A non-Markovian model of quantum repeated interactions between a small quan- 
tum system and an infinite chain of quantum systems is presented. By adapting and 
applying usual projection operator techniques in this context, discrete versions of the 



Q"^ ' integro-differential and time-convolutioness Master equations for the reduced system 

■ are derived. Next, an intuitive and rigorous description of the indirect quantum 
, measurement principle is developed and a discrete non Markovian stochastic Master 
I equation for the open system is obtained. Finally, the question of unravelling in a 

■ particular model of non-Markovian quantum interactions is discussed. 

o\ ' 
o 

1 Introduction 

X 

^ \ The theory of Open Quantum Systems describes the physical phenomena of dissipation and 
decoherence p!3l [TU [TH [35] . Starting from the microscopic formulation of the interaction 
between a small system and an environment in terms of the Schrddinger equation, there 
exist different ways to derive the Master equation for the irreversible evolution of the small, 
i.e., reduced system. Typically, two approachs are considered: the Markovian and the non- 
Markovian one fnij. A very active line of research is focused on developing an appropriate 
description of indirect quantum measurements within both approaches. This research is 
motivated by recent experiments in quantum optics and quantum information [23]. 

Physically, the Markovian approach is understood as a model without memory effects 
of the environment In this set up the Master equation takes the form of a Lindblad-Gorini- 
Kossakowski-Sudarshan equation [25l [27], where the generator of the dynamics is a com- 
pletely positive map [131 (H (HI [SS, [27] . This equation is an ordinary differential equation, 
which describes the evolution of the state of the small system and the study of differ- 
ent physical phenomena: entropy, decoherence, return to equilibrium. Mathematically, 
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the approach makes use of the Born-Markov Approximation or the Weak Coupling Limit. 
Starting from the Hamiltonian description of the Schrodinger equation, tracing over the 
degrees of freedom of the environment and neglecting the memory of the interaction, the 
Markovian Master equation is obtained. 

In the Markovian context measurement involves a stochastic perturbation of the Lind- 
blad equation in terms of stochastic differential equations, i.e.. Stochastic Schrodinger 
equations [6]. These equations have some remarkable properties. First, they conserve the 
purity of states, i.e. unravelling (the term "stochastic Schrodinger equation" is mainly used 
when the equation preserved purity otherwise it is called "stochastic Master equation"). 
Second, the expectation of the stochastic Schrodinger equation reproduces the dynamics 
induced by the Markovian Master equation for the density matrix of the open system. 
These properties are very useful for the numerical simulation of the Master equation. In 
fact, the so-called Monte Carlo Wave Function Method is used extensively in quantum 
optics and quantum information []. 

In the non-Markovian approach, memory effects of the environment give rise to gener- 
alized Master equations, i.e., integro-differential equations for the density operator of the 
open system. Usually, these equations are obtained by projection operator techniques, e.g. 
the Nakajima-Zwanzig Operator Technique [36l ?] or the Time Convolutioness Operator 
Technique . These techniques allow for the formal description of more realistic models. 
However, the generalised Master equations are difficult to manipulate [I3l [33]. Even if 
formally exact analytical solutions can be obtained, these are very hard to solve numer- 
ically. In the non-Markovian context, the stochastic equations describing measurement 
procedures are usually expressed in terms of colored noise [28l [T71 [18] (the Markovian case 
involves only white noise). The justification of such models is far from being obvious and 
intuitive. Often, rigorous arguments are missing. Moreover, the question of non-Markovian 
unravelling is still highly debated [ISl[ISl[ni[ISl[I2l[2ni[Ml[2Il[22]. 

In the Markovian case, a rigorous approach to the description of interaction and mea- 
surement lies in the theory of Quantum Stochastic calculus |29]. In this setup, the action of 
the environment (described by a Fock space) is modeled by quantum noises and the evolu- 
tion is given by the solution of quantum stochastic differential equations ^ l23J . Quantum 
filtering theory [3 [S| is based on quantum stochastic calculus in order to describe quan- 
tum measurement and to derive Stochastic Schrodinger equations. Recently, in this spirit, 
a discrete model called Quantum Repeated Interactions has been introduced [3l [1] . This 
model provides a "useful" approximation of the interaction between a small system and 
an environment. The model is a small system Tig in contact with an infinite chain of 
quantum system representing the environment. All the elements of the chain are identical 
and independent. Pieces of the environment, denoted by Ti, interact one after the other 
with Tio during a time r. Hence, by renormalizing the interaction in terms of r, quantum 
stochastic differential equation models can be obtained as a continuous limits (r goes to 
zero) of quantum repeated interactions models. This approach has been adapted to the 
context of measurement in [SUl [311 [32] • It corresponds to the model of Quantum Repeated 
Measurements. It has been shown that stochastic Schrodinger equations can be obtained as 
continuous limits of the discrete version of quantum measurement. Furthermore, via con- 
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Crete procedures, the approach gives an intuitive and rigorous interpretation of quantum 
stochastic differential equations and stochastic Schrodinger equations. 

The main aim of this article is to present the non-Markovian model of quantum repeated 
interactions and discrete measurement. We define a clear mathematical model of the 
effect of the memory of the environment in this setup. Furthermore, we show that the 
natural technique (Nakajima-Zwanzig, Time convolutioness) used in the continuous non- 
Markovian approach can be adapted to the discrete context. We present a clear way to 
perform quantum repeated measurement in the non-Markovian case. As a result we obtain 
a rigorous discrete expression for the evolution of the small system with and without 
measurement. Finally, we investigate the problem of unravelling in this context. For a 
concrete model, we show that in the non-Markovian case unravelling imposes a Markovian 
structure except for some very special cases. The article is structured as follows. 

In Section [21 we present the mathematical model of quantum repeated interactions in 
the non-Markovian case. We adapt the presentation of [3] to introduce memory effect of 
the infinite chain. 

In Section[31 we obtain the description of the evolution of the small system by computing 
the Nakajima-Zwanzig and Time Convolutioness projection operator technique. Especially, 
we obtain a discrete version of the evolution described in the previous investigations for 
continuous case (see [13] for all details concerning the continuous version). 

Section m is devoted to the introduction of a model of measurement. We present a nat- 
ural way to perform measurements in the context of non-Markovian Quantum Repeated 
Interactions. We define a probabilistic setup describing the random evolution of the small 
system. By adapting Nakajima-Zwanzig projection operator technique, we obtain a rigor- 
ous expression of an evolution equation which is a discrete version of the non-Markovian 
stochastic Master equation. Next, we investigate the question of unravelling by studying 
a special case of non-markovian quantum repeated interactions. We show that unravel- 
ling imposes strong assumptions for the evolution which in general lead to a Markovian 
dynamics. 

2 Quantum repeated Interaction Model 

This section is devoted to the description of the discrete model of quantum repeated inter- 
actions in the non-Markovian setup. We start by reviewing briefly the Markov treatment 
of quantum repeated interactions [3]. The canonical model is described as follows. A small 
system Tio is in contact with an infinite chain of identical and independent quantum sys- 
tems (each element of the chain is denoted by Ti). Each copy of Ti interacts with Tio in 
the following fashion. The first copy of Ti interacts with the small system during a time r 
and disappears afterwards. Then, the second copy interacts with Ho during the same time 
interval r and so on. Physically, the fact that after each interaction the copy disappears is 
the Markov approximation. 
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Let us now describe the mathematical setup for the non-Markovian quantum repeated 
interactions. The main idea is to keep the memory of each interaction. 

As the chain is supposed to be infinite, the state space of the chain is described as 

oo 

i=i 

where Tij ~ Ti for all k. To formulate the precise definition of this infinite tensor product 
we fix an orthonormal basis {Xq, . . . , Xk} of Ti. (where + 1 is the dimension of Ti). The 
state \Xo){Xo\ can be regarded as the ground state. The basis of T$ is constructed with 
respect to the stabilising sequence induced by Xq. 

To this end, let V be the set of subsets of the form A — . . . , {nk,ik)}, where 

/c G N*, {ii,. . .,ik} e {1,. . .,K + 1}'', and rii < . . . < with Uj e N*. The basis of r$ 
is denoted hj B = {Xa, A e V}, where ior A & V the vector Xa corresponds to 

Xa^ Xo® . . .Xq® Xi^® Xo® . . .Xo<^ Xi^® . . . 

and the vector X^ appears in the copy number rij of 7i. 

Let us now define the basic operator. On B{H), the canonical operator with respect to 
{Xq, . . . , Xk} is denoted by a^-, that is, for all (i, j, k) e {0, X}^ we have 

(iij{Xk) = Sjk Xi. 

By extension, we denote by a\j the operator acting as a^j on H^, which is the copy number 
k of H. On we have 

k-l 

3=1 j>k 

The index k without round bracket means that the operator aij is set on the place number 
k is the infinite tensor product. 

Hence, the coupled system, system and chain, is described by the Hilbert space 

r^Ho^T^. (1) 
We endow this Hilbert space with the following state 

oo 

= (2) 

3=1 

where p is a reference state of Tip and f3j = (3 for all j, with (3 = \Xq){Xo\ is the reference 
state of H (this corresponds to a system at zero temperature) 

Let us now describe the interaction setup. The first copy of Ti. interacts with Tig during 
a time r. After this interaction a second copy of 7i interacts with Tio and the first copy. 
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that is 7-^2 interacts with Hq^Hi and so on. As a consequence, the k-th copy of H interacts 

fc-i 

with Hq ® ^^'Hj, that is we keep the memory of the previous interactions 
i=i 

Mathematically, we consider a sequence of unitary operators (Uk) for k > 1. For each 

k 

k the operator Uk acts non-trivially on Ho ® ^^Hj and acts like the identity operator on 

i=i 

Hj The sequence of unitary operators (V^) which describes the repeated quantum 

j>k+l 

interactions is defined by putting 

Vk = Uk...U^ (3) 

for all k (the operator Vk describes the k first interactions). Hence, in the Schrodinger 
picture, after k interactions, the initial state fj, defined by ([2]) becomes 

= Vkfiv:. (4) 

It is straightforward to see that ^k+i = f^fc+i/Wfcf^fc+i The sequence (/ife) describes the 
evolution of the system in the quantum repeated interaction setup with memory. 

It is important to notice, that in the Markovian case, the unitary operator Uk acts only 
non-trivially on the tensor product of Tio with Tik, which is the k-th copy of Ti. On the 
rest of the Hilbert space, it acts like the identity operator. In the homogeneous case fro 
example, the operator Uk can be expressed, for all k, as 

K 

i,j=0 

where Uij are operators on Tio- In the following, to ease the notation, we suppress the 
symbol ® in similar expression 

In order to generalize the above class of Markovian models, which have been studied 
extensively in [3], we apply the classical projection operator technique of Nakajima-Zwanzig 
and its time-convolutioness version to the non-Markovian quantum repeated interactions 
model (see [13] for general introduction for Nakajima-Zwanzig and time-convolutioness 
operator technique). 

3 Discrete Non Markov Evolution Equation 

This section is devoted to the description of the discrete evolution of the small system in 
the non-Markovian case. In the first part 13. we apply the Nakajima-Zwanzig operator 
technique and in the second part 13. 2^ we investigate the equivalent of time-convolutioness 
projection operator technique for the discrete case. 
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3.1 The Nakajima-Zwanzig Projection Operator Technique 

We start by applying the Nakajima-Zwanzig projection operator technique to the sequence 
(/Xfc) introduced in (jll). For any state a on F, we define the Nakajima-Zwanzig operators: 



Qa = a — Va, (6) 

where TrT$[a] represents the partial trace of a with respect to the chain. In the canonical 
approach, the operator V projects onto the relevant part of the small system. The aim 
is to obtain an evolution equation which describes the sequence (V^k) representing the 
evolution of the relevant part of Hq- 

For a fixed k, the projection operators Vjik+i and QjJik+i are given by 

= PUk+iVfikU^+i + VUk+iQfikU'k+i, (7) 
Q/ifc+i = QUk+iVfikU'k+i + QUk+iQf-ikU'k+i- (8) 

For all operators a on B(T), let denote 

Ckia) = UtaUl (9) 

Iterating (IHl) and taking into account the non-commutativity of the operator Ck, we obtain 
the following expression for Qnk+i 

k / i \ 1 

= n (^(/^o) ) + Q^^k+i n (2(/^o)). (10) 

i=0 \ j=k / j=k 

It is important to notice, that the operator in the large round brackets in the above equation 
corresponds to a discrete version of the time ordering exponential term appearing in the 
non-Markovian continuous case (see [13]). Obviously, the first term Q(/io) = 0. Hence, by 
replacing the expression (fTOj) in the expression ([7]), we get 

'k-l 



Vfik+1 = VCk+i(Vfik) +VCk+ilj2QCk n Q^j{^f^i 

\i=0 j=k~l 
k-l / i \ 

= vck+i {Vfik) + ^'^'^+1 n Q"^^ (^-"0 ■ ^^^^ 

i=0 V j=k / 

The above expression describes the complete time evolution of the relevant part of Tio- 
Like in the continuous case, it appears as a discrete integro-differential equation which 
involves all the history of the evolution. 
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It might be interesting to see how the Markovian description emerges from the more 
general approach described above. As in the continuous case, we obtain a discrete version 
of the Lindblad, Gorini, Kossakowski, Sudarshan evolution equation as is shown in the 
following proposition. 

Proposition 1 Let (Uk) be a sequence of unitary operators which describe a Markovian 
evolution. For all k, for all i < k and for all state 7 on T, we have 

i 

VCu+i\{QC,{Vi) =0. (12) 

j=k 

Hence the expression fli ip becomes 

Furthermore, in the Markovian homogeneous case ^ there exists a completely positive 
map C acting on BiTio), such that for all k 

Vfik+i = c(Vfik)- (13) 

Proof: Let us start by showing the last part of the proposition. Recall that the operator 
(Uk), in the homogeneous Markovian case ([5]), can be expressed as 

K 

ij=Q 

Since, for all k, the operator V^, defined in equation acts only on the k first copies of 
7i, it is worth noticing that for all k 

00 
j=k+i 
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Hence for all k and all X G B{T-Cq) 



Tr 



Tr 



Tr 



Tr 



Tr 



Tr 



4 E f^^-^f^^ 



(fc+l) 



Tr 



m>fc+l 



I ® 



''OO 



PJ 



Tr 



j>k+l 



''00 



j>k+l 



Tr 



Tr 



Ef/o,(TrT*M)t^o* ) X 



= Tt[c(TttM)X\. (14) 

This proves that Vfik = ^{'Pf^k)- It is interesting to notice, that we have obtained the 
Kraus decomposition of the completely positive map C f|T^ (see [21 [13] for more details). 
This result was obtained in a different way in [3j. The equivalent proposition for the non 
homogeneous case can simply be otained by replacing the terms Uij by the non homoge- 



neous terms 



(k+i) 



Now we turn our attention to the first part of the proposition. Equation (fT2|) follows 
from the fact, that for all operators a of the form 



a = 7] 



''00' 



j=k+i 



with 7] any operator on i3(7io ® ®^j=i '^j)-> have 



(15) 



(16) 
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Indeed, with the definition of the operation V and the unitary operators (f/fc), it is straight- 

i 

forward to see that the operator JJ^ QCj {j^l^ is of the same form as an operator a ( |T5i) . 
Now, we are in the position to prove the result flTBl) . The operator a can be expressed 

as 

«= «(n,ii),...,fe,jfe)®«iiji®---®«!;,ife®(8)"oo- 

(n,ji),...,(ife,jfc)g{0,...,/s'} j>k 
Then, with our notation and with the rule of the partial trace, one can see that 



00 



Accordingly, for Qa, we obtain 

2« = ^h,n).■■,{^..3.) ® <,3. ® • • • ® ® ® «00, (17) 

(iljl),...,(ifc,ifc)G{0,.--,i^} 3>k 

with 

/5(o,o),...,(o,o) = - ^ a(ii,n),...,(ifc,ife) 

{il,...,ifc)7^{0,...,0) 

= all (ii, ji), . . . (4, jfc) ^ (0,0), . . . , (0,0). 

By applying Ck+i on Qa ( TT7|) . we get 

= Y1 An,ji),...,fe,ife) f^/o ® ® • • • ® ® flii ® (g) "00 

{ii,ji),...,(ik,jkMO,...,K} j>k+l 

The result f ll6l) is proved by noticing that 

oo 

VUk+iQaU*,^, = Y Y ^io%,n),...,fe,i.)f^i'o®(8)«'oo 

i ii,...,ifee{o,...,x} j=i 



Y ^0 Ao,o)...(o,o) t^/o ® ® 



00 



i ii,...,ife^O,...,0 j=l 

0. 



00 



This completes the proof of the proposition. 
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3.2 The Time-convolutioness Projection Operator Method 

In this Section, we apply the time convolutioness version of the Nakajima-Zwanzig operator 
technique to the framework of non-Markovian quantum repeated interactions. The aim is 
to derive a discrete time-evolution equation for {Vfik) which links Vfik+i only to Vfik- 
To this end, for all p, we define the inverse of the operator Cp as 



for all operators a. It is straightforward to see that for all p we have fip = Cp_^i (fip+i) . 
Hence, the expression ffTOl) obtained in the previous section becomes 



fc+1 



i=0 
k 



j=k 



p=j+l 
fc+1 



i=0 j=k p=i+l 

k i fc+1 



fc+ly 



i=0 j=k p=i+l 

k i fc+1 

+ Y,Qi^k+iX{QC,v n 4"'^(Q/^fc+i) 

2=0 j=k p=i-\-l 

k / 1 \ / k-\-l \ 

E n 2 A SAP n 4-^mk.i 

i=0 \j=k+l / \p=i+l / 

k / i—1 \ / k-\-l \ 

+E n 2 A SAP n 4-^M(2^^ 



2=0 \j=fc+l / \p=i+l 

For a fixed m, we define for all operators a G i3(r) the following 

m / i—1 \ / m+1 

/c^+i(a)=^ n SAP n4"'Mw- 

j=0 \j=m+l / \p=i+l 



The expression (fTSll becomes 



— ^fc+i 



Hence, if we assume that 



fc+1 



Q^^fc+i — ^fc+i'P/^fc+i- 



is invertible, we get 



fc+1; 



fc+1 



(-1) 



f^k+l'PfJ'k+l- 



:i8) 



(19) 



(20) 
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As a consequence, for the expression of V^k+i can now be written as 









(-1) 


P/ifc+i = VCk+iVfik + VCk+1 




I - ICk 





The expression ( !2T|) is the discrete time-convolutionless equation of evolution for the re- 
duced system. The invertibihty of / — /C^ imphes the discrete equivalent of the locality in 
the time continuous case (see [13] for more details). 

4 Non Markov Quantum Repeated Interactions With 
Quantum Measurement 

In the Markovian case the theory of quantum measurement and the corresponding evolu- 
tion are well understood and well studied. This is not the case in a non-Markovian set 
up. One of the open questions concerns the description of the evolution of the reduced 
system undergoing indirect quantum measurement. The way to describe the random non- 
Markovian evolution of the reduced system in the continuous time case is far from obvious 
and in general it is based on heavy technique [HI [21] . 

In this section, we present a very clear mathematical and physical way to describe indi- 
rect quantum measurement in the discrete non-Markovian setup. The approach consists of 
adapting the quantum repeated measurement [3] in the non-Markovian quantum repeated 
interactions model. We will show how to derive a discrete non Markovian stochastic Master 
equation. 

We proceed in the following way. After each interaction, implying a new copy of 
7i, a quantum measurement is performed on the last copy which has interacted. Each 
measurement involves a random evolution of the state of the system F. The repeated 
sequence of measurement gives rise to a random sequence of states on F. Then, we apply 
the Nakajima-Zwanzig operator technique on this sequence in order to obtain the evolution 
of the relevant part of the reduced system TIq. In fact, this strategy is very natural and 
does not require any phenomenological inputs. 

After this, we will consider the problem of unravelling. Obtaining unravelling in the 
non-Markovian case imposes strong assumptions on the interaction setup. Focusing on a 
special case, we show that essentially unravelling implies the Markov assumption except 
for very special situations. 

4.1 Quantum Repeated Measurements 

We start by describing the setup of quantum repeated measurements on the whole system. 
After each interaction, a measurement of an observable is performed on the last copy of H. 
which has interacted. 

We need to introduce some notations. Let A = Yl^=o ^i-^i spectral decomposition 

of an observable of Ti. In analogy to the construction of the basic operators a) - in Section 
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2, we introduce 

fc-i 

A^^^ = I®^I®A® (g) /. 

i=l j>k+l 

The operator A'^^\ which is an observable of Tifc, is the extension of the observable A to the 
whole space F ([T]). In the same way, for all i G {0, . . . ,p} we denote the eigen-projectors 

as 

fe-i 

,(fc) 



i=l j>k+l 

Let us describe a single interaction and a single measurement. After the first interaction 
the state of the system is described by yUi = UifiU^, where /i is the initial state ([2]). 
According to the postulates of quantum measurement only the eigenvalues of A^^^ can be 
observed; the result is random and obeys to the probability law 

P[to observe Aj] = Tr /ii P-^^ 

Furthermore, if we have observed the eigenvalue Ai, the state of the system becomes 



Tr 



The new state pi is actually a random variable. It describes the result of one interaction 
and one measurement. 

Let us make precise the probabilistic framework of the complete procedure of quantum 
repeated measurements. To this end, we introduce the probabilistic space 

S = {0,l,...,p}^\ 

where the index i corresponding to the eigenvalue A^. We endow this space with the cylinder 
algebra C generated by the set 

^ii,...,ik = {uJ e \ ui = ii, . . . ,uJk = ik} ■ 

Now, we define a probability law on the cylinder set. To this end, we introduce for all 
G {0,...,py : 

1 k 

j=k j=l 

To simplify the above expression, we introduce the notation 
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Hence, by using the definition of the operations we get 



j=k 



(23) 



This corresponds to the non-normahzed state, if we have observed the eigenvalues Aj^ , . . . , Aj^, 
The probabihty law on the cylinder set is now defined as 



P[A,,...,J = Tr 



It is easy to check that the above definition satisfies the Kolmogorov consistency criterion. 
As a consequence, it defines a unique probability law P on Now for all k and all 

G S we can define the following random variable 



Tr 



IJ,k[UJl, . . . ,UJk) 



The quantum repeated interactions combined with quantum repeated measurements are 
then described by the random sequence (pk)- Such a sequence is called a discrete quan- 
tum trajectory (on the whole space). To complete the description of discrete quantum 
trajectories on the whole space, we have the following Markov property. 

Proposition 2 The random sequence (pk) is a Markov chain on (f2, C, P) valued in the 
set of states on T. 

Furthermore, if pk = is a state on T the random variable pk+i takes the values 



Pk+l 



Tr 



t^i ^k+i[Pk) 



0,...,p, 



with probability Pi = Tr 



-Tj L,k+i{Pk} 



In the next section, we apply the Nakajima-Zwanzig projection operator technique 
to the random sequence {pk)- As in the case without measurement (see Section [371]) . this 
allows for the description of the evolution of the relevant part of the system. The projection 
on the reduced system gives rise to a random sequence of states of T^o, which is, in general, 
non-Markovian. 



4.2 Non-Markovian Stochastic Discrete Evolution Equation 

This section is devoted to the description of the discrete stochastic evolution equation of 
the reduced system obtained by the Nakajima-Zwanzig projection operator technique. The 
equation we obtain is a discrete version of the non-Markovian stochastic Master equations 
(see [m [21] for continuous version). 
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Let (pk) be a quantum trajectory as described in Proposition [2l For all k and for all 

i G {0, . . . ,p} we denote the transition probabilities by p^^^ = Tr[P^ Ck+i{pk)]- Hence, 
with Proposition [2], we can describe the evolution of (pk) by the following equation 

(Pr'A+i)(Pfc) k+i (^.^ 
Pk+i - 2^ -xk ' 

where the indicator functions l^"*"^ corresponds to the observation of the eigenvalues Aj 
during the {k + l)-th measurement. By applying the Nakajima-Zwanzig operator V and 
Q introduced in Section [3TT] to (IMl) . we get 

i=0 ^« 

ami = sftff5^i%?l^i?- 



, j=0 



Pi 



i=0 ^* i=0 

By iteration, as is done in the case without measurement, we get the following expression 

for Qpk+i 

Qp^+i = E E fi Q{p\A)i'pp.) n ^ 

i=0 (ifc+i,...,ij)6{0,...,p} Z=fc+1 i=fc+l ^'i 

+ E ri s(Ha)(qp„) n 7^ 

-EE ri QiT'im^p,) ri 1^- (25) 

i=o (ifc+i,..,ip)e{o,...,p} i=fc+i i=fc+i 

The last equality in fl25|) comes from the fact that Q(po) = Q(/^o) = 0. Hence, we get the 
following equation 



i=0 ^« 

+E E T'(p:;;A«)fn£)(p'.,£,)(T'ft)) ri ^-(26) 

i=o (jfe+i,ife,...,ii)e{o,...,p} \i=k / z=fc+i 
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In order to express the above equation only with terms P/ij, it is worth noticing that for 
all k and for all i 



p. 



k+l 



Tr 
Tr 
Tr 



Tr 



By replacing the expression of Qpk with ( !25l) . we get an expression involving only terms 

Vp^. 

The expression ( l26l) describes then the random evolution of the relevant part of the 
system. It is typically a non-Markovian chain evolution, because the expression at time k 
involves all the past of the sequence. The equation fl26l) is the discrete version of the non- 
Markovian stochastic Master equation. The sequence iVpk) is called the reduced quantum 
trajectory. 

In the Markovian case (see [35j for a complete study), by applying a result similar to 
Proposition [21 the evolution equation (126!) is reduced to 



i=0 ^1- 

and describes a Markov chain. The last subsection is devoted to the investigation of the 
pure state evolution in the non-Markovian case. 



4.3 Non Pure State Quantum Trajectory 

The success of the Indirect Quantum Measurement Theory and the Quantum Trajectory 
Theory in the Markovian case lies in the fact that the indirect measurement gives rise to 
a pure state evolution for the reduced system. This means that, if initially the state of Ho 
is pure, the reduced quantum trajectory evolves on the set of pure states of Tio [3113]. As 
is made precise in the Introduction, such a property is widely used in Monte Carlo Wave 
Function methods for the simulation of the Quantum Markov Master Equation. 

In this section, we start by recalling the pure state property for the discrete quantum 
trajectory in the Markovian case. Next, for a specific model, we investigate the conditions 
under which a pure state trajectory can be unravelled in the non-Markovian case. 



4.3.1 Markovian unravelling 

In this subsection, we show that the measurement of an observable which has different 
eigenvalues (with eigen-space of dimension 1) provides the unravelling result in the Marko- 
vian case. 
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Proposition 3 Let (Uk) be a sequence of unitary operators describing a quantum repeated 
interaction setup in the Markovian case. Let A be an observable whose spectral decomposi- 
tion is given by 



K 



i=0 



where K +1 is the dimension ofTi. Let po = |V'o)(V'o| be the initial state of Ho- Let (Vpk) 
be the reduced quantum trajectory describing the evolution of the state of TYq in' the setup 
of quantum repeated measurements of A. 

Then, there exists a random sequence of vectors (ipk) ofTio such that 



\Xo){Xo\. 



(27) 



Proof: By recursion, suppose that there exists ■j/'fc such that Ppfe = l^ipk) {i'kl^^'^i |-^o)(-^o|- 
As the evolution of V{pk) in the Markovian case is given by 



^P^+i = E ^,'P{pT^k^i)i'Ppk) 1 



fc+i 

m ' 



m=0 ■ 



it is sufficient to show that each Ck+i{Vpk)/p^^ can be expressed as f l271) . To this 

k^\ 

end, we make exphcit the expression of Ck+i{Vpk) for all m G {0, . . . ,K}. Let us 
consider a homogeneous Markovian evolution (the non homogeneous case can be easily 
adapted). With the same notation as in the proof of Proposition [21 we get the following 
for Ck+i{Vpk) 

k CO 

Ck+1 [Vpk) = ^Um\i)k) {ipk\U jo ® (g) aoo ® CLij^^ ® ® «oo- 

ij 1=1 l=k+2 

As the observable A has eigenvalues of rank one, for all m G {0, . . . , K} the projector 
Pm is a rank one projector. Hence there exists a unitary operator such that Pm = 
\QmXo) {Q^XqI. This allows to write 

pT^k+i{'Ppk) = 



Xlf^i0|^fc)(^fe|f/;0 ® ® ^00 ® {QmXo,Xi){Xj,Q^Xo)\Q^Xo){QmXo 



"00 



1=1 



l=k+2 



^00- 



1=1 



l=k+2 



Hence, we get 
Try^ 



p'^^'Ck+iiVpk) 



J2{QmXo,Xi)u,oi^k){ Y,iQmXo,Xj)u,ot 



\dk+l){0. 



k+l\ 



The normalisation factor p'^^ gives the right expression of ipk+i and the recursion holds. 
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4.3.2 Non Mcirkovian unravelling 

In this section we investigate the unraveUing in the context of non-Markovian quantum 
repeated measurements. 

Our discussion will be based on a typical physical application, namely a two level atom 
(a qubit) in contact with a chain of spins. Mathematically, for this model Tio = = C^. 
Let us make precise the description of the interaction. Let k be fixed, the interaction 
number k is defined by a total Hamiltonian Htot{k) of the following form: 

H,,,{k) ^Ho + Hnik) + XHi{k), (28) 

where: 

• The operator Hq corresponds to the free Hamiltonian of Ho- It is a self-adjoint 
operator acting non-trivially on Hq and acting like the identity operator on the 
chain. 

• The operator Hii{k) is the free Hamiltonian corresponding to the free evolution of 
the k first copies of H. It acts non-trivially on (S)j=i s-^id like the identity operator 
elsewhere. If H corresponds to the free evolution of one copy of we have 

k / i-l \ k 

HR{k)^j2[^^'S)^^^^ ^ = J2^^'^- 

1=1 V j=l j>i+l / i=l 

In our context, the natural Hamiltonian of a single copy is H — 7000, where 7 is a 
real constant. 

• The self- adjoint operator Hi{k) is the interaction Hamiltonian. It acts non-trivially 
on Ho ® ^'j=i 'Hj and like the identity operator elsewhere. The interactionHamilto- 
nian Hi{k) is given by 

k 

Hi{k) = Y,[c,{k)atl+Ct{k)4l), 
1=1 

where Cj are operators on Tio- In other words, each copy interacts with T^o, but 
they do not interact with each other. This is a simple physical case describing a 
non-Markovian memory effect (at each new interaction, the previous copies continue 
to interact). 

• The term A is a real scalar corresponding to a coupling constant. 

If the time of each interaction is r, then the unitary operator U^is defined as 

Hence, it describes a non-Markovian quantum repeated interactions. The non-Markovian 
character comes from the definition of Hi{k). 
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Remark: It is worth noticing, that if Hi{k) acts non-trivially on the tensor product of 
with Tik and hke the identity operator elsewhere, we recover a Markovian approach of 
quantum repeated interactions. Actually, it does not correspond directly to the previous 
definition of Markovian interaction but it is equivalent to it. Indeed, at the k-th interaction 
the fact that Hjik) acts non-trivially on the tensor product of Tio with Tik and like the 
identity operator elsewhere, means that only Ck{k) is a non zero operator. Hence, the 
{k — 1) first copies do not interact with Tio, while we can keep the definition of their free 
evolution. In the first definition of the Markovian case we do not refer to the free evolution 
of the {k — 1) first copies which could mean that we keep a kind of memory, but by taking 
the partial trace this memory disappears. 

Our strategy to study the unravelling question in this context is the following. We 
start by considering the two first interactions, that is TYq coupled with Tii and next with 
Ti-i ® 'H2- With a general approach, we show that the condition of unravelling imposes 
assumptions on the definition of the interaction. Next, we translate this assumptions in 
terms of the interaction model fl28p . Finally, by considering the small interaction time r, 
we show that unravelling imposes to "forget" the interaction with Tii during the second 
interaction, except for a very special case. Let us stress that forgetting the interaction with 
Til during the second interaction corresponds to the Markovian assumption. 

The space describing the two first interactions is Hq ® 7Yi (8> 7^2- Let 

be a unitary operator describing the first interaction and let 

ij=0,l k,l=0,l 

be a unitary describing the second interaction. Let A = XqPq + AiPi be the measured 
observable and let p = be the initial state of Hq- 

Concerning the observable A there exist unitary matrices Qm, m = 0,1 such that 
Pm = IQm^o) {QmXo\. Accordiug to the unravelling result in the Markovian case, the first 
random state pi on Hq ®TCi® TC2 can take one of the values 

— ^|^/'i(m))(^i(m)| ® \QrnXo){QmXo\ ® |Xo)(Xo|, m = 0,1 
Zi(m) 

where ipi{m) = \ J2iiQmXo, Xi)Uioilj) and Zi corresponds to the normalisation factor. 
Hence the state Vpi is a pure state. For the second interaction and the second measure- 
ment, we introduce the following notation 
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In the same way, the second state p2 can take one of the values 



p2{m,n) 
1 

with {m,n) G {0, 1}^. The accurate computation of Vp2{fn,n) gives 



^(g„Xo,x„)(x,,g„Xo)£«o(^^iM ® \q^Xo){q^Xo\^ciA ® |g„Xo)(Q„Xo| 



Vp2{m,n) 



1 



Z2{m,n) 



Hoim, n)ipi{m) ) ( Hoim, n)ipi{m) 



Hi{m, 71)1^1(171) )( Hi{m, 71)1^1(171) 



1 „ 2 

Cloo '^00' 



where 

Hi{m, n) = '^{QnXo, Xy) {X^, QmXo) Ui^u,v,o, i = 0, 1. 

u,v 

As a consequence, unravelhng is possible if the following condition is satisfied 

7ii(m, n)il)i{m) ) ( Hi{m, n)ijji{m 



Ho (m, 7i)ipi (m) ^ {T-Co{7n, 7i)ipi (m) 

= \lp2{7n,7l)){lp2i7n,7l)\, 

for some vector ilj2{'m,n). If we want a rank one projector to be expressed as the sum of 
two rank one projectors there exist constants p and u such that 

p Hoirn, n)ipi + p 7ii(m, n)ilji = 0. 

In general, p and u will depend on n, m and also on ipi. Here, we assume that there exist 
non zero constants p{m,n) and v{rn,n) such that 



v{m, n) Ho{m, n) + p{m, n) 7ii(m, n) = 0. 



(29) 



This assumption will be justified later after the discussion regarding unravelling. 

Now, our aim is to show how the condition fl29|) is connected to the possibility of 
obtaining unravelling in the case of the interaction (1251) . The condition fl29l) imposes a 
relation between the coefficients Uij^k,i of the unitary operator 1/2- Let us express these 
coefficients in the interaction model (1251) . The total Hamiltonian for two interactions is 
defined by 

Htot = Ho^ I ^ I + I ®-faoo^ I + I ^ I ^-fttoo 
+C2(2) ® / ® aio + ^2(2) 0I0 aoi). 
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In order to describe the coefficients of U2 in terms of i^tot, we introduce an appropriate 
basis of Hq^Ui® 7^2, which is Xq®Xq® Xq, Xi (g) Xq O Xq, Xq ® Xi O Xq, Xi (g) Xi (g) 
Xo, Xo (g Xo (g Xi, Xi (g Xo (g Xi, Xo (g Xi (g Xi, Xi (g Xi (g Xi. Hence, we can write 

/ Uo 

f^l,0,0,0 ^1,1,0,0 * * 

t^o,o,i,o Uo,i,ifi * * 
\ Uifi^ifi t/1,1,1,0 * * / 

(30) 

By studying the asymptotic expansion of U2 = e"^^°^ in term of r, one can find operators 
Lij„k,i{j) such that 

f^o,o,o,o = I + tLqqq{t), t^i, 1,0,0 = ^ + i"^iioo(^), (31) 

f/0,1,0,0 = rCi(2)Lo,i,o,o(r), f/1,0,0,0 = rQ(2)Li,o,o,o(r), (32) 

f/0,0,1,0 = rC2*(2)Li,o,o,o(r), t/1,1,1,0 = rC2(2)Li,o,o,o(T), (33) 

f/0,1,0,1 = r2Ci(2)Li,o,o,o(r), f/i,o,i,o = r2cr(2)Li,o,o,o(r). (34) 

Furthermore, each operator Lij^k,i{T) converges to a non zero operator when r goes to zero. 

Now, by comparing this asymptotic description in terms of r and the condition ( l29l) . we 
investigate the question of unravelhng. The result depends on the form of the observable 
A. There are two different situations. 

The ffist situation corresponds to the case where Pq = |Xo)(Xo| (this is equivalent to 
the case where Pi = |Xo)(Xo|). In this case we have the corresponding Qq = I, then 
(Xq, QqXo) = 1 and the condition (12^ for m = n = gives 

'^(0,0)f/o,o,o,o = MO,0)t/i,o,o,o. 

Hence, the asymptotic conditions (^T\~ \ 34p impose Ci(2) = 0. This situation corresponds 
to the Markovian case. 

As a consequence, for any observable where Pq = |Xo)(Xo| (or Pi), the unravelling 
condition imposes the Markovian approach since the memory of the interaction with the 
ffist copy disappears Indeed, by recursion, for the third interaction and measurement, a 
similar reasoning shows that the unravelling condition imposes to forget the memory of 
the second copy and so on. 

The second situation concerns the case where < (XcQmXo) < 1, m = 0, 1. Indeed, 
if for m e {0, 1}, we have (Xq, Qm^o) £ {0, 1}, which corresponds to the ffist case. Now, 
the condition (12^ and the asymptotic conditions 34p give 

(^z/(m, n) (Q„Xo, Xq) (Xo, Q^Xq) - ^(m, n) (Q„Xo, Xq) (Xi, Q^^Xq)^ / = r W{t), 

where W{t) converges to an operator when r goes to zero. Hence, it imposes that 

yjm.n) ^ (Xi,Q^Xo) 
/i(m, n) (Xo, QmXo) ' 



tot 



( Ho + 27/ 
AQ(2) 
AQ(2) 



v 







ACi(2) 


AQ(2) 



AC2(2) 


Ho + -fI 
AQ(2) 



\ 

AC2(2) 
ACi(2) 
Ho J 



Uo 
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Now, let deal with the terms in r^. If Ci{2) ^ Ci(2)*, we get an equality of the following 
form 



t'^Z{t) = tY{t), 

where Z{t) and Y{t) converge to non zero operators, when r goes to zero. As a conse- 
quence, if Ci(2) 7^ Ci(2)*, we cannot get unravelling. 

Let us now suppose that Ci(2) = Ci(2)*. The condition (1291) and the asymptotic 
conditions (1311— I 34p give 

(^u{m, n) (Q„Xo, X,){X,, Q^Xq) - ^(m, n) (Q^Xq, Xi) (Xq, Q^Xq)^ Ci(2)X(r) 
= rM(r), 

where X(r) and M (r) converge to non zero operators when r goes to zero. It imposes the 
condition 

Hm,n) (Xq, Q^Xq) 
lj,{m,n) (Xi,Q^Xo) 

The case Ci (2) = corresponds to the Markovian approach and the result in Section 14.3.11 
imposes naturally the unravelling result. Otherwise, the condition (l35l) combined with the 
condition fl5^ implies that 

(Xo, QmXof = (Xi, QmXof, m = 0, 1. 

It is easy to notice that, this condition corresponds to special observables of the form 

^ = ( 1/2 1/2 )^^'{ -1/2 1/2^ ) ■ ^^^^ 

This means that in the non-Markovian case with the interaction model fl28l) . the unravelling 
result can not be obtained if the measured observable is not of the form fl?r|) with Ci(2) = 
Ci(2)*. 

Reciprocally, we can now exhibit a special model of interaction fl28|) that allows unrav- 
elling. We consider that for all {i, k) G N, we have Ci{k) = Ciik)* (this corresponds to the 
assumption Ci(2) = Ci(2)*). Furthermore, we assume that there is not free evolution con- 
cerning the infinite chain, that is 7 = 0. Moreover, to use directly the previous discussion, 
we suppose that at each interaction only two copies of Ti interact with Tig- Mathemati- 
cally, for /c > 2, at the fc-th interaction, we consider that only the copies number k and 
number k — 1 interact with TYq- In other words, for A; > 2, at the /c-th interaction, we have 
Ci{k) = for all 1 < i < /c — 2. Now, for an observable of the form fl37j) . by computing 
girj/tot^ it is easy to see that 

T-Co{m, n) = Hi{m, n), m, n = 0, 1 

and the condition fl2I?]) is fulfilled. As only the last incoming copy and the previous one 
interact with TYq at each interaction, a recursive reasoning shows that we obtain unravelling 
in this case. 
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Let us finish by justifying that the condition 

V Ho{m, n)ipi + jji Hi{m, n)ipi = 0, 

for constant v and depending on n, m and ■0i imphes that 

i/(m, n) 7io{m, n) + ii{m, n) 7ii{m, n) = 0, 

without dependence in ipi. This result stems from the following proposition in linear 
algebra. 

Proposition 4 Let Di = {ip e C^/||^/'|| = 1} be the unit disk. Let cf) he a linear application 
such that for all \x) e Di there exist A such that (t>{\x)) — \\x), then there exists A such 
that for all \x), we have (t>{\x)) — \\x), that is (p — XI. 

In our case, we aim to apply this result to 7io{m,n)~^7ii{m,n) for appropriate m and 
n. Indeed, it is worth noticing that for r small enough, there always exists (m, n) e {0, 1} 
such that the operator T-lQ{m,n) is invertible. Indeed there always exists {m,n) G {0,1} 
such that Ti.{m,n) is of the form al + tF{t), where F{t) converges when r goes to zero 
and a is non null. 

Remark: For all non diagonal observables this property is satisfied for all couples (m, n). 
For the diagonal observable, we can consider the case m — n — 0. 

To conclude, it remains to prove that random vectors ipi cover all the unit disk. This is 
justified as follows. The rules of the first interaction and the first measurement give rise 
to a random transformation A from Di to Di, which maps ipo in a random unit vector ipi. 

For all observable A, it is worth noticing that for a r small enough there exists 
m e {0, 1} such that the operator J^iiQm^o, ^iWio is invertible (for the non diagonal 
observable for all m this property is satisfied, for the diagonal observable it corresponds to 
the case m=0). As we must consider all the possible results for the measurement, in any 
case, there exists at least one possibility that the range of A is Di and the result holds. 
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